Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] neural biasing with early context injection and text perturbation #1763

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[WIP] neural biasing with early context injection and text perturbation #1763

wants to merge 1 commit into from

Conversation

huangruizhe
Copy link
Contributor

@huangruizhe huangruizhe commented Sep 30, 2024 •
edited
Loading

This PR implements the paper: Improving Neural Biasing for Contextual Speech Recognition by Early Context Injection and Text Perturbation
. This also addresses issue #1709 .

This codes can replicate the paper, but it is still a WIP -- needing codes refactoring and cleaning up.

TODO:

  • Make soft links to the original standard ASR recipe -- avoid copying scripts
  • Expose neural biasing and so on as an external function call to contextualize the models
  • Simplify the scripts for loading contexts -- only need an example for librispeech
  • Get evaluation scripts for common/rare words as in the contextual librispeech setup

@huangruizhe
This is the initial commits for neural biasing implementation with ea…
78b7ef3 
…rly context injection and text perturbation; the codes runs well on the grid; however, it needs pretty much cleaning up and refactoring before maki a reasonable PR
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@huangruizhe